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In  this  paper  we  propose  a simple  nalve^  estimator  of  the  failure  rate  function. 
This  estimate  is  asymptotically  unbiased  but  not  consistent.  It  can  be  smoothed  by 
using  any  band  limited  window.  We  show  that  this  smoothed  estimate  is  equivalent  to 
estimates  obtainable  from  the  modified  sample  hazard  function,  as  in  Rice  and 
Rosenblatt  (1976).  We  obtain  the  asymptotic  distribution  of  the  global  deviation 
of  the  smoothed  estimate  from  the  failure  rate  function,  which  can  then  be  used  to 
construct  uniform  confidence  bands.  We  illustrate  the  rate  of  convergence  of  our 
estimator  by  a Monte-Carlo  simulation. 
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Abstract . 

In  this  paper  we  propose  a simple  naive  estimator  of  the  failure  rate 
function.  This  estimate  is  asymptotically  unbiased  but  not  consistent. 

It  can  be  smoothed  by  using  any  band  limited  window.  We  show  that  this 
smoothed  estimate  is  equivalent  to  estimates  obtainable  from  the  modified 
sample  hazard  function,  as  in  Rice  and  Rosenblatt  (1976).  We  obtain  the 
asymptotic  distribution  of  the  global  deviation  of  the  smoothed  estimate 
from  the  failure  rate  function,  which  can  then  be  used  to  construct  uniform 
confidence  bands.  We  illustrate  the  rate  of  convergence  of  our  estimator 
by  a Monte-Carlo  simulation. 

1.  Introduction. 

The  failure  rate  function  is  one  of  the  most  important  parameters  in 
reliability  theory.  Several  parametric  and  non-parametric  methods  for  its 
estimation  have  been  proposed  in  the  literature.  Most  of  these  methods 
make  specific  and  restrictive  assumptions  concerning  the  underlying  distri- 
bution. 

In  this  paper  we  first  propose  a very  intuitive  (and  naive)  estimate 
of  the  failure  rate  function,  and  study  its  properties  in  Section  2.  Our 
estimate  does  not  require  specific  assumptions  on  the  underlying  distribution 
and  is  thus  non-parametric.  We  show  that  our  estimate  is  asymptotical ly 
unbiased,  but  not  consistent,  hurt her  more,  it  is  shown  that  the  naive 
estimate  of  the  failure  rate  function  at  two  distinct  points  are  asymptotically 
independent.  A paradox  concerning  the  estimate,  reminiscent  of  the  famous 
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inter-arrival  time  paradox  illustrated  by  Feller  [(1966)  Vol.  2,  p.  11], 
is  shown  in  Section  3.  The  above  facts  limit  any  direct  use  of  the  naive 
estimator  for  estimating  the  failure  rate  function. 

In  Section  4,  we  propose  smoothed  estimators  obtained  by  averaging 

« 

the  naive  estimator  r by  a band- limited  window.  We  show  that  these 

n 

smoothed  estimators  rR  can  be  approximated  by  an  appropriate  Gaussian 
process  (Theorem  4.5),  and  thus  obtain  the  asymptotic  distribution  of  the 
global  deviation  on  any  finite  interval.  This  result  can  be  used  to  construct 
confidence  bands  for  the  failure  rate  function  (Theorem  4.10).  Section  5 
contains  some  results  of  a Monte-Carlo  experiment  which  illustrates  the 
performance  of  our  smoothed  estimators. 

The  main  steps  in  the  proof  Theorem  4.5  may  be  described  as  follows. 

Bickel  and  Rosenblatt  (1973)  have  pioneered  a new  technique  of  proof  to 
approximate  the  normalized  and  centered  sample  density  function  by  a sta- 
tionary Gaussian  process.  The  basic  step  in  their  proof  is  a use  of  the  then 
Table  result  of  Breiman  and  Srillinger  approximating  the  normalized  and 
centered  enpirical  distribution  function  by  a Brownian  bridge.  Rosenblatt 
(1976)  has  strengthened  these  results  by  using  the  recent  stronger  results 
of  Komlds,  Major  and  Tusnddy  (1975).  Rice  and  Rosenblatt  (1976)  have  pro- 
posed three  estimates  h^ , h^2\  and  h^  of  the  failure  rate  function 

n n n 

which  are  non-parametric  in  nature.  They  have  directly  applied  the  strengthened 
results  of  Bickel  and  Rosenblatt  on  the  density  function  to  obtain  the  asymp- 
totic global  results  for  h^.  They  have  also  shown  that  h^  is  asymp- 
totically close  to  . By  approximating  the  normalized  and  centered 
sample  hazard  functions  HR  by  a Weiner  process  under  a monotone  transform 


'i  lg  04  Obi 
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of  time,  we  obtain,  in  much  the  same  way  as  Bickel  and  Rosenblatt,  the 

asymptotic  global  deviation  results  for  our  smoothed  estimate  r and  the 

n 

Rice  and  Rosenblatt  estimator  h^^ . In  the  course  of  this  proof,  we  also 
show  that  h^2^  and  h^  are  uniformly  asymptotically  equivalent  to  our 
smoothed  estimate  rR  on  each  finite  interval.  Other  nonparametric  estimates 
of  the  failure  are  studied  in  Shaked  (1973)  and  Ahnad  and  Lin  (1977) . 


2.  The  Naive  Estimate  and  its  Properties. 

Let  Xj,X2,...,Xn  be  independent  and  identically  distributed  random 
variables  with  a common  distribution  function  F(x).  We  shall  assume  that 
F(0)  ■ 0 and  that  F(x)  possesses  a density  function  f(x) . The  failure 
rate  function  of  F(x)  is  r(x)  « f(x)/F(x)  where  F(x)  ■ 1 - F(x).  The 
hazard  function  H(x)  is  -log  F(x)  (defined  whenever  F(x)  > 0)  and  « 

H(x)  ■ r(x) . The  purpose  of  this  paper  is  to  provide  estimates  of  r(x) 
and  to  obtain  the  asymptotic  distribution  of  the  global  deviation  of  these 
estimates. 

The  naive  estimate  rn(x)  of  the  failure  rate  is  defined  as  follows: 


(2.1)  rn(x) 


1 


(n-i*l)(X(ij-X(il)) 


, if  X^  jj  i x < X 
i * 1,2, ... ,n 


, if  xi  X(n) , 


(i) 


where  0 ■ X ^ i X^^  s ...  s X^  are  the  order  statistics  of  Xj,X2, . . . ,3^. 
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This  estimate  has  been  used  by  Singpurwalla  (1975)  wherein  he  used 
a time  series  approach  for  analyzing  failure  rates  in  contaminated  data. 
Before  the  time  interval  *(i)^  there  have  been  (i-1)  failures; 

thus  only  (n-i+1)  are  still  functioning  in  this  interval,  and  one  item  is 
to  fail  at  the  right  end  point  of  this  interval . It  is  therefore  intuitive 
to  assign  a constant  failure  rate  in  this  interval  and  to  define  the  naive 
estimator  rn(x)  as  in  (2.1).  Another  motivation  ::or  (2.1)  is  that 
the  failure  rate  in  the  interval  [X^  X^)  should  be  the  reciprocal 

of  the  'total  time  on  test'  in  that  interval.  The  limiting  distribution 
of  rn(*)  is  obtained  in  Theorem  2.1  below. 

Let  G(a;  X)  denote  a gamma  random  variable  with  scale  parameter  a 
and  shape  parameter  X;  that  is  the  density  function  is 

X -xci  X-l 

o e x /r(X),  x > 0. 

Notice  that 

E(G(a;  X))  ■ X/a  for  X > 0 

and 


E(l/G(o;  X))  - o/(X-l)  for  X > 1. 

Let  G *(«;  X)  * 1/G(a;  X);  G *(0;  X)  is  usually  referred  to  as  the  inverse 

gamma  random  variable. 


1 


* 


Theorem  2.1. 
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(i)  P(l/r  (x)  s a ) + J e'^^^yfr (x))2dy; 

0 


that  is 

l/rn(*)  *►  G(r(x),  2)  in  law. 

Consequently 

rnW  2)  inlaw. 

(ii)  Let  be  distinct.  Then  {r^Xj)  ,rn(x2) , . . . .r^) > 

are  asymptotically  independent. 

Proof.  Fix  x,  and  let  0 < F(x)  < 1.  Let  i be  the  random  suffix  satisfying 
X(i-1)  * X < X(i) 

“herein,  we  set  ■ 0,  and  Xjn+1j  » •;  thus  i can  take  values  l,2,...,n. 

Since  i has  a binomial  distribution  with  parameters  n and  F(x), 

(2*2)  ^ F(x),  in  probability  as  n 


Conditional  on  i,  the  distribution  of  (X(1)f .. ..X(i-1))  and  (X(i) , . . . ,X(n)) 

are  those  of  the  order  statistics  of  independent  sample  os  size  (i-1)  and 
(n-i+1)  from  the  truncated  distributions  F^  and  F*,  respectively,  where 


d 
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px(y)  - 


F(y)/F(x) 


y s x 


y > x 


F*(y) 


y s x 


(F(y)  - F(x))/F(x)  y > x. 


Standard  extreme  value  theory  for  extreme  values  shows  that 


(2.3)  An  - (i-l)f(x)(x-X(i  lJ)/F(x)  -►  G(l,  1)  in  law 


(2.4)  Bn  - (n-i*l)f(x)(X..  -x)/F(x)  -►  G(l,  1)  in  law. 


Note  now  that 


1/r  (x)  « Hi!*1-  ££0-  A + F(x)  g 

' VXJ  i-l  ToET  An  + TftT  n 


It  follows  from  (2.2),  (2.3),  (2.4)  and  the  conditional  independence  of  A 


and  B given  i that 
n 


^ 2)*  in  law- 


This  proves  pert  (i). 


We  will  now  briefly  indicate  the  proof  of  part  (ii).  For  sisplicity, 
^*2»  *nd  that  Xj  < x^ . Let  ij  s i^  be  the  random  suffixes 

satisfying 


W1)  ^ *2  < Vp  md  X(i2-D  *'*2  < X(i  ) 
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Then,  conditional  on  ij  and  i^. 


(X 


(l),...,X(ii_l)).  (x(ip,...,X(i2  d),  and  (X(i^ , . . . ,X(n)) 


become  the  order  statistics  in  independent  samples  from  three  truncated 
distributions.  Si^.ce  the  minimum  and  the  maximum  of  a sample  are  asymptotically 
independent,  and  r^Xj)  depends  on  and  ^ only,  and  rn(x2) 


depends  on  X^  and  X^  ^ only,  we  can  imitate  the  earlier  part  of  our 


proof  to  show  that  rn(xj)  and  rn^x2^  are  as>rinPtoticaliy  independent. 


3.  Remarks  on  Theorem  2.1. 

The  important  conclusions  that  can  be  drawn  from  Theorem  2.1  are  the 
foi lowing: 

(i)  rn(x)  is  not  a consistent  estimate  of  r(x) ; indeed,  rn(x)  has 
a limiting  non-degenerate  distribution. 

(ii)  While  the  asymptotic  mean  of  rn(*)  is  r(x),  we  can  actually 
show  that 

E • 

The  factor  of  2 in  the  above  result  is  quite  surprising,  and  is  remini- 
scent of  the  inter-arrival  paradox  so  well  explained  in  Feller  [(1966)  Vol.  2, 

p.  11). 

(iii)  Since  (rn(xi) » • • • *rn(xjc))  are  asymptotically  independent, 
the  graph  of  (rn(x),  xiO)  will  exhibit  wild  fluctuations,  and  will  not 

a good  estimator  of  the  failure  rate. 


* . . . i- 
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4.  A Smoothing  of  the  Naive  Estimate. 

The  phenomenon  described  in  the  previous  section  is  similar  to  the 
behavior  of  the  periodogram  in  estimating  the  spectrum  of  a stationary  time 
series.  We  shall  therefore  use  the  standard  technique  of  'smoothing'  the 
naive  estimate  with  a 'window'  to  obtain  a consistent  and  asymptotically 
normal  estimate  of  the  failure  rate. 

A window  is  a function  w(u)  such  that 


(Wl) 

w(u)  = w(-u)  2 0 

(W2) 

/ w(u)du  a 1. 

The  window  is  said  to  be  band-limited  if 
(W3)  w(u)  » 0,  for  | u | 2 A, 

and  to  be  bounded,  if 
(W4)  0 S w(u)  S M < . 

The  smoothed  estimate')  of  the  failure  rate  depends  on  the  window  w(u) 
and  a sequence  (b  } sati  Tying 

(Bl)  b -*>  0,  and  nb  -*■  •». 

n n • 

Without  loss  of  generality,  we  may  assume  that 
(B2)  0 < bn  S A. 
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We  define  the  smoothed  estimator  rn(x)  obtained  by  smoothing  r 


with  the  window  w and  bandwidth  2b  A as  follows- 

— n 


(“.D  rn(x)  - 


r/»(Fk 

n v n 1 


(s)ds 


■ / «(s)rn(x-bns)ds. 


When  w is  a bandlimited  window  (i.e.,  satisfies  (W3)),  rn(x)  will  be 

used  as  an  estimate  of  r(x)  only  for  x s bnA,  since  the  smoothing  being 

done  in  (4.1)  does  not  include  the  whole  bandwith  of  w when  x < b A. 

n 

Define 


(4.2) 


* i-1  , x - X,.  .. 

R (x)  * / r (y)dy  * Y — ; — + (x~l) 

o " jil 

for  s x « x(i). 


nF„(x) 


* Vx>  for  11  ‘ x(„) 


where  0 s 8 (x)  s — i — . 

nFn(x) 

We  may  now  re-write  r (x)  as 

n ' 


?„(x>  ' 


* 
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The  following  lemma  shows  that  Rn(x)  and  Hn(x)  = -log  Fn(x) 
(defined  only  for  x < X^)  are  uniformly  close  to  each  other  in  bounded 
intervals. 


Lemma  4.1.  Fix  K < •;  then 


(4.3)  sup  |R  (x)  - H (x) | s 

OsxSK  n 2nFn(IC) 


if  F (K)  > 0;  i.e.,  if  K < X,  . . 

n (n) 


Proof.  We  shall  use  the  elementary  inequality 


I x + log(l -x)  I £ 2^1,_x‘)  for  0 s X < 1. 


Note  that 


nFn(x) 


nFn(x) 


(4.4)  Hn(x) 


-iog  Fn(x)  * log  ^ log(l  - ^ 


From  equations  (4.2)  and  (4.4),  if  x £ K < X^ , 

nF„(x) . 


- H»w  s l 


nFn(x) 


l |jT*  logfl  - £)|  ♦ ~~ 

n-nF_(x)*l|K  1 kll  nF  I 


nFn(x) 


11 


s 


l 

n-nFn(K)*l 


n-nFn(K)+l 


nFn(K) 


1 1 n-nFn(K)+l  j 

2n-nFn(K)*l  n-"Fn^  + ^0 


3 1_ 

2 n¥n«>  ' 


II. 


Rice  and  Rosenblatt  (1976)  have  introduced  a class  of  estimators 
h„3^(x),  where 


hj3)(x)  -^/»(^)dHn(s). 


In  Lemma  4.2  we  will  show  that  our  smoothed  estimator  r (x)  is  uniformly 

(3)  n 

close  to  h^  ' (x)  on  bounded  intervals. 


Leaaa  4.2.  Let  w be  a bounded  band  limited  window;  that  is,  w satisfies 
» (W2) , (W3)  and  (K4).  Let  w also  satisfy 

(V/5)  /|w'(x)  |dx  S c < •, 

where  w*  is  the  derivative  of  w. 

Let  the  constants  {bn>  satisfy  (Bl)  and  (B2) , and  let  K < -.  Then 

(4.5)  sup  |r  (x)  - hf3)(x)|  s 2® 

" " 2nbnFn(K+A) 

(n)  * 


whenever  K*A  s X 


s £ iff)2 -i -1— 

n-nFn(l')*1  U 1 • n-nFnW>l  "F„<IO 


2 , n-nFn(K).l  j 

nv  ' 


3 1 


2 "".to 


Rice  and  Rosenblatt  (1976)  have  introduced  a class  of  estimators 


h^(x),  where 


hr<*>  ■ f / - T*Kt.) 


In  Lemma  4.2  we  will  show  that  our  smoothed  estimator  rn(x)  is  uniformly 
close  to  h^^(x)  on  bounded  intervals. 

Lemma  4.2.  Let  w be  a bounded  band  limited  window;  that  is,  w satisfies 
(Wl) , (W2) , (W3)  and  (W4) . Let  w also  satisfy 


(W5)  /|w'(x) |dx  s c < «, 


where  w'  is  the  derivative  of  w. 


Let  the  constants  (bn>  satisfy  (Bl)  and  (B2),  and  let  K < -.  Then 


(4.5)  sup  |r  (x)  - h^3)(x)|  s ?£ 

<*XSK  " " 2nbnFn(KM) 


whenever  K*A  s X,  „ . 

(n) 
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Proof:  Notice  that,  for  x s K s X,  _ - A 

Cn) 

|Fn(x)  - hi3)(x)l  * ItT  / w T1  dtR„(*)  - Vs)  J I 

n n 

^ "(^f)  [R"(S)  " Hn(S)J 

/ l%w  - v«l 

(since  x s K,  b s A,  and  x+b  s K+A) 
n n ' 

* from  Lemma  4.1  and  (WS)  . 

2nbnFn(K+A) 

Define 


x«-b  A 
n 

x-b  A 
n 


In  Theorem  4.4,  we  will  show  that  the  process  (£n(x),  bfiA  £ x £ K} 
is  uniformly  close  to  a stationary  Gaussian  process.  Because  of  Lemma  4.2, 
this  same  result  (Theorem  4.S)  will  also  apply  to  the  process  (Cn(x),  b^A  £ x £ K}. 


In  Theorems  4.6,  and  4.7,  we  obtain  the  asymptotic  distribution  of 

“ax  |c  (x) | and  max  |c  (x)|.  In  order  to  make  these  results  useful 

b AsxsK  b A£x£K  n 

n n 

for  obtaining  uniform  confidence  bands  for  r(x),  bnA  £ x £ K,  we  will  have 
* 

to  replace  rn(x)  by  r(x)  and  also  replace  any  unknown  quantities  that 
enter  in  the  asymptotic  theory  by  their  estimates.  This  is  done  in  two  stages, 
in  Theorem  4.9  and  Theorem  4.10.  The  result  in  Theorem  4.10  is  in  the  most 
useful  form  for  applications.  Define 

Zn(x)  - /n(Hn(x)  - H(x)). 


Theorem  4.3.  There  exists  a Gaussian  process  (Z(x),  0 s x s K*A)  with 
mean  function  zero  and  E(Z(x),  Z(y))  » B(x)  for  x £ y,  and  such  that 
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Proof : In  the  rest  of  this  paper  we  use  the  generic  name  D for  any  random 
variable  with  P(D  < «)  ■ 1. 

From  Komlds,  Major  and  Tusnddy  (1975),  there  is  a Gaussian  process 
(Y(x),  0 s x)  with  mean  function  zero  and  E(Y(x)Y(y))  » F(x)(l-F(y)) 
for  0 s x £ y,  and  such  that 


sup | /n(F  (x)  - F(x))  - Y(x)|  = w.p.  lt 

o*x  n SZ 


Since  > K + A,  we  have  for  0 s x £ K+A, 


^ Fn(x) 
Zn(x)  ■ -VZ  log  — 


F(x) 


-/n  log 


1 Fn(x)-F(x) 


1 ♦ 


F(x) 


log 


1 - -Y1X.L  ♦ p 1°8  n 


Jn  F(x)  nF(x)  J 


Y(x)  + D log  n 
F(x)  SZ 


■ Z(x)  ♦ D 


log  n 


/Z 


where  Z(x)  ■ XL*2.  § 0 s x s K+A.  It  is  easy  to  see  that 

F(x) 


(Z(x),  0 s x s K+A)  is  Gaussian  with  mean  0,  and  E(Z(x)Z(y))  - B(x)  for 
x s y.  This  completes  the  proof.  i j 


I 
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(W(s),  -co  < s < «}  denote  a Weiner  process,  and  define 

00 

c(e)  3 / w(e-t)dw(t),  o s e < co. 


Then  (C(6),  0 s 6 < •}  is  a stationary  Gaussian  process  with 

00 

E(C(0) ) 3 0 and  E(c(©  ♦ «) C(©))  = / w(6+t)w(t)dt  = p(6)  (say). 

-00 

We  now  need  to  impose  further  conditions  on  the  distribution  function  F: 

(FI)  B"  (x)  is  bounded  on  0 s x s K, 

and 

(F2)  inf  B' (x)  > 0. 

0<xSKM 


Theorem  4.4.  Let  w satisfy  conditions  (W1)-(IY4).  Let  (Bl),  (B2),  (FI) 
and  (F2)  hold.  Then  there  exists  a stationary  Gaussian  process 
Un(6).  A s 6 s K/bn>  which  is  a restriction  of  U(9)}  for  A s e s K/bn> 
such  that 


(4.10) 


*up  U_(x)  - C_(x) 

b AixSK 
n 


*fib  F (KM) 
n nv  ’ 


Proof : The  proof  of  this  theorem  follows  by  going  through  steps  which  are 
analogous  to  those  used  by  Bickel  and  Rosenblatt  for  their  Propositions  2.1 
and  2.2.  and  using  the  key  approximation  result  in  Theorem.  4.3.  M 
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Theorem  4.S:  Theorem  4.4  is  true  with  5nU)  replaced  by  Cn(s). 


Proof:  Immediate  from  Theorem  4.4  and  Lemma  4.2, 


In  order  to  obtain  the  asymptotic  distribution  of  max  |s  (x) | and 


max  U fx),  we  will  let 


b ASxsK 
n 


C4.ll) 

and 


A(w)  * / w2(t)dt. 


(4.12)  K.tw)  . “ t^-A)  , 

If  K^(w)  = 0,  we  shall  require  that 
(W6)  / (w'(t))2dt  < » 


b A<xSK 
n 


(notice  that  (W6)  implies  (W5)),  and  set 


(4.13)  K2(w)  * / (w'(t))2dt/2A(w) . 

Let 

(4.14)  cn  » (2  log  (K/bJ)’5. 

Define 

(4.15)  Bn  - cn/(A/w)):i, 


and 
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(4.16)  an  - (A(w))*4[cjj  ♦ logCc^W/^J/CH 
when  w satisfies  (W1)-(W5)  and  K^w)  > 0, 

(4.17)  an  - (A(w)),*[c^  * log(K2(w)/n)]/cn 


when  w satisfies  (W1)-(.V4),  (W6)  and  K^w)  = 0. 


Theorem  4.6.  Let  M * max  | C (x) | . 


b^xSK 


Let  (Wl)-(WS)  hold  with  K^(w)  > 0 


or  (Wl) -W(4)  and  (IY6)  hold  with  K^w)  = 0.  Let  (Bl),  (B2) , (FI)  and  (F2) 


hold.  Then 


(4.1*1  P{0  (M  - a ) S z)  -►  e" 

n n n 


for  0 < x < ». 

Proof:  Follows  from  Theorem  4.4  and  the  results  on  the  extrema  of  a stationary 
Gaussian  process  with  an  autocorrelation  function  p(0)  given  in  Appendix  A 
of  Bickel  and  Rosenblatt. 

Theorem  4.7.  Let  * max  It  (x)l.  Theorem  4.6  holds  with  M renlar.nd 


by  Mn. 


« a max  |C.(x)|.  Theorem  4.6  holds  with  M replaced 

n b ASxsK  n n 

n 


Proof:  Immediate  from  Theorems  4.S  and  4.6. 

In  order  to  obtain  results  which  are  useful  for  applications,  we  will 
have  to  replace  r*(x)  in  En(x)  and  En(x)  by  r(x).  We  shall  now 
indicate  the  steps  which  enable  us  to  do  this.  Ke  impose  a further  condition 
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on  F which  implies  (F2)  if  F(K)  > 0: 

(F3)  r(x)  is  twice  continuously  differentiable. 

Lemma  4.8.  Let  (F3)  hold.  Let  (Wl),  (W2)  hold.  Then 

(4.19)  sup  |r*(x)  - r(x)|  s Lb2 
OSxSK  n n 

where  L is  some  finite  number. 

Proof : Now, 

r^(x)  - r(x)  - / w[^i]dH(s)  - r(x) 

n n ' 

■ / [r(x  ♦ tbn)  - r(x) Jw(t)dt 
A (tb  )2 

* / [tbnr'(x)  ♦ 5— (r~(x)  +y(x,  t,  bn))]w(t)dt 

where  y(x,  t,  bn)  + 0 uniformly  in  x,  t 

2 A y 

- b T"{X)  I t w(t)dt(l  ♦ 0(1)], 

-A 

and  0(1)  is  uniform  in  x. 

Thus  sup  |r*(x)  - r(x)|  i Lb2  where  0 i L < «. 

OixSK  " n 

Let  the  constants  bn  satisfy  the  condition 

(B3)  nbf  log  b -*>  0. 
n n 


19 


For  instance  t>n  ■ n'a  with  ~ < a < ~ will  satisfy  (Bl)  - (B3). 

Theorem  4.9.  Under  the  additional  assumption  (B3)  holds,  we  may  replace 

r*(x)  by  r(x)  in  the  definitions  of  £ ( x) , T (x) , M and  Fi  , and 

n n n n 

Theorems  4.6  and  4.7  will  continue  to  hold  for  the  new  M and  M . 

n n 

Proof : Note  that 

/2  log  K/bn  (hj3)(x)  - r(x)) 

- n log  K/bn  (h*3)(x)  - r*(x)) 

♦ /2  log  K/bn  /riT  (r*(x)  - r(x)) 

- cn^(x)  5n(x)  ♦ 0(/nb^  log  K/bn) 

• cn/B'(x)  Cn(x)  ♦ o(l). 

This  fact  proves  the  theorem.  ||. 

Notice  that  the  denominator  /fe'(x)  (-  *r(x) /F(x})  in  the  definitions 
of  Cn(x)  and  5n(x)  is  wknown.  In  Theorem  4.10  we  replace  B'(x)  by 
an  estimate  to  obtain  uniform  conficence  bands  for  r(x)  using  our  smoothed 
estimator  rn( x ).  In  an  analogous  manner,  we  can  also  obtain  unifrom  confi- 
dence bands  for  r(x)  using  h^3^(x). 

Theorem  4.10.  Let  (Wl)  - (WS)  hold  with  Kj(w)  > 0 or  let  (*1)  - (*4), 

(H6)  hold  with  K.(w)  - 0.  Let  (Bl)  - (B3) , (FI),  (F3)  hold.  Let  o 
4 n 


t 
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and  8n  be  as  defined  in  (4.15),  (4.16)  and  (4.17).  Then 

(t  * “J  * rW 


(4.20)  P 


r„(x) 


r„(x) 


"bI,F„(X> 


4 r„(x)  . 


r„(x) 

h 

fjL  * a 1 

nb  F (x) 
n n . 

l n nj 

-2 


-Z 


for  0 < z < *». 


Proof:  This  theorem  follows  from  the  fact  that  rn(x)/Fn(x)  and  h^  (x)/Fn(x) 
are  uniformly  estimates  of  B'(x). 

Remark:  To  obtain  a 100a%  uniform  confidence  band  for  r(x)  for  bnA  s x £ K 
we  use  the  two  functions 


r„(x)  i 


r„(x) 


nb„Fn<x> 


- ♦ a 
Sn  n 


with  z - -log  (-(1/2)  log  a). 


5.  An  Illustrative  Example  With  Simulations. 

A smoothing  window  which  is  quite  natural  'rich  also  turns  out  to 

be  coiqxitationally  simple,  is  the  uniform 

(5.1)  w(u)  - i,  |u | < 1. 

This  w satisfies  (Wl)  - (W5)  with  K^w)  - ~ > 0. 
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In  order  to  obtain  an  expression  for  rn(x)  using  this  window,  we 
shall  make  use  of  the  following  elementary  results. 

For  any  x e [r-1,  r] 


It  follows  from  the  above  that 


n-k 

l 


r*n-j+l 


r 


- n-k 

logM 


and 


n-k*l 

l 


r«n-j>2 


1 

r-1 


* log 


n-k+1 
n-j*l  * 


For  any  x 2 0,  and  any  specified  bn>  let  * (j-1)  be  the  number 

of  observations  (failures)  to  the  left  of  x - bn>  ■ (k-j*l)  the  number 

of  observations  between  x ♦ b and  x - b , and  Z,  * (n-k)  be  the  number 

n n o 

of  observations  to  the  right  of  x ♦ bn>  Also  let 


Uj  "(n-i*l)(X(|)-X(i_1^  for  X(i-1)  5 X < X(i)’ 
x 

i ■ l,2,...,n.  If  W(x)  ■ / w(s)ds,  then 

0 


r"(1°  ■ A x(/_n  r lucr  - tJ 


For  w(.)  given  by  equation  (5.1),  we  have 


nL  j 


^■|.xu?~(x"bn)  + !mi)"xu) * * A(i)~A(i-i) 


x,^-x,s 


. X(k)-X(k-1)  . X*V 

T • • • T , , t ■ 1 


n~X(k) 

'k+l 


or  that 


(S.3)  r"  (x) 


1 

rx0)-(x-bn> 

2bn 

u. 

•••  Tn-i>l)U(i)  + •**  + 


x*vW 

Vi 


Based  upon  the  above  and  the  elementary  results  presented  before,  we 
can  write 


i n"J  i _ , n-i+i 

2b;  I F s Vx)  * 2b~  I ? 

n n-k«-l  n n-k 


The  left  hand  inequality  is  obtained  by  ignoring  the  first  and  the 
last  terms  of  (5.3),  whereas  the  right  hand  inequality  is  obtained  by 
setting  x ♦ bn  =»  X^^  and  x - bn  = in  the  last  and  the  first 

terms  of  (5.3),  respectively. 


cs&iiHfthaSSaSSiSiaiiiS&inifirc1 
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Thus 


25"  108  5&T  5 rn(x)  s 55T  108  Sikrf-  or 


1 ^2*^3  — 1 Z2+^3 

W log  TfT  s rn(x)  * 2FT  log  T~T 
n 3 n 3 


In  view  of  the  above,  a computationally  simple  expression  for  rfl(x)  is 


— 1 Z2*Z3 

(5.4)  rn(x)  = ^ log  4-1 

n 3 


5.1.  Results  of  a Monte-Carlo  Experiment. 

In  this  section  we  shall  summarize  our  experience  with  the  estimator 
given  by  equation  (5.4),  based  on  a Mont 6 Carlo  experiment. 

Random  samples  of  size  n (*  10,  15,  20  and  50)  were  generated  from 
an  exponential  distribution  with  scale  parameter  1.0,  and  a Weibull  distri- 
bution with  shape  parameter  2.0,  respectively.  For  each  sample  size  we 

obtain  r (x)  using  a uniform  window  with  b„  ■ , for  a ■ 0.05,  0.10,  0.15, 

n n a 

n 

0.20,  0.25,  and  0.75.  We  repeat  this  procedure  500  times  for  each  of  the 
specified  24  combinations  of  sample  size  and  window  width.  Based  upon  the 
results  of  these  500  trials,  we  calculate  at  each  point  x,  the  average, 
the  standard  error,  and  the  root  mean  square  error  of  rn(x) • These  statistics 
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i 


are  summarized  in  Table  S.l  for  the  exponential  distribution  at  the  point 
x - 1.0,  and  in  Table  5.2  for  the  Weibull  distribution  at  the  point  x - 0.5. 

In  Figure  S.l  we  show  a plot  of  the  average  value  of  ?n(x)  at  each 
point  x,  based  on  n ■ 10  and  a =»  0.75  for  the  exponential  distribution, 
whereas  in  Figure  5.2  we  show  a similar  plot  for  n • 50.  In  Figures  5.3 
and  5.4  we  give  plots  analogous  to  those  in  Figures  5 1 and  5.2,  respectively 
but  for  the  Weibull  distribution. 

On  the  basis  of  the  above  described  experiment,  we  can  state  the 
following  by  way  of  conclusion: 

i)  For  samples  as  small  as  10  or  15,  the  smoothed  estimator  obtained 
by  using  windows  of  small  width  is  generally  unbiased;  the  bias  increases 
with  the  width  of  the  window.  This  phenomenon  is  especially  true  for  points 
in  the  middle  of  the  range  of  x. 

ii)  The  standard  error  decreases  with  the  width  of  the  window. 

iii)  It  appears  that  towards  the  end  points  of  the  range  of  x,  a 
smoothed  estimator  based  on  a narrower  window  width  performs  better  than 
one  based  on  a wider  window  width. 

The  above  comments  suggest  the  possibility  of  using  windows  of  varying 
widths.  A version  of  this  strategy  has  been  considered  by  Miller  and 
Singpurwal la  (1978).  For  further  details  on  the  Mont6-Carlo  experiment, 
we  refer  the  reader  to  Chandra  (1977). 
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TABLE  5.1 

SAMPLING  PROPERTIES  OF  SMOOTHED  ESTIMATOR  OF  THE  FAILURE  RATE 
AT  THE  POINT  x - 1.0  FROM  AN  EXPONENTIAL  DISTRIBUTION 


l-' 

■ - — — -1 

— 

SAMPLE 

SIZE 

WINDOW  WIDTH 

^AN 

STANDARD  ERROR 

ROOT  NEAN 
SQUARED  ERROR 

10 

0.356 

1.0649 

1.0259 

1.0280 

1.125 

0.9362 

0.5126 

0.5166 

1.262 

0.9178 

0.4854 

0.4923 

1.416 

0.8518 

0.4517 

0.4754 

1.589 

0.8240 

0.4608 

0.4932 

1.782 

0.7710 

0.4396 

0.4961 

IS 

0.262 

1.1780 

1.1004 

1.1147 

1.016 

1.0373 

0.5153 

0.5167 

1.164 

1.0248 

0.4376 

0.4383 

1.332 

1.0452 

0.4327 

0.4350 

1.526 

0.9704 

0.3974 

0.3985 

1.747 

0.9306 

0.4019 

0.4079 

20 

0.212 

1.0978 

0.8748 

0.8802 

0.946 

1.0537 

0.4501 

0.4533 

1.099 

1.0751 

0.4123 

0.4191 

1.276 

1 . 0353 

0.3658 

0.3675 

1.582 

1 . 0376 

0.3606 

0.3626 

1.722 

0.9966 

0.3452 

0.3452 

50 

0.106 

1.0145 

0.7258 

0.7259 

0.752 

1.0237 

0.2835 

0.2845 

0.915 

1.0183 

0.2599 

0.2605 

1.112 

1.0479 

0.2449 

0.2495 

1.353 

1.0280 

0.2284 

0.2301 

1.645 

1.02S1 

0.1982 

0.1998 

TABLE  5.2 


SAMPLING  PROPERTIES  OF  SMOOTHED  ESTIMATOR  OF  THE  FAILURE 
RATE  AT  THE  POINT  x - 0.5  FROM  A WE  I BULL  DISTRIBUTION 


SAMPLE 

SIZE 

WINDOW  WIDTH 

MEAN 

STANDARD  ERROR 

ROOT  MEAN 
SQUARED  ERROR 

10 

0.356 

1 . 0459 

0.6402 

0.6419 

1.125 

1.0769 

0.4614 

0.4678 

1.262 

1.0314 

0.4598 

0.4609 

1.416 

0.9773 

0.4189 

0.4195 

1.589 

0.9309 

0.4644 

0.4695 

1.782 

0.8130 

0.4744 

0.5099 

IS 

0.262 

1.0530 

0.5870 

0.5894 

1.016 

1 . 0746 

0.4022 

0.4091 

1.164 

1.0649 

0.3874 

0.3928 

1.332 

1 . 0995 

0.3783 

0.3912 

1.526 

1.0549 

0.3818 

0.3857 

1.747 

1.0063 

0.4144 

0.4144 

20 

0.212 

0.9351 

0.5809 

0.5811 

0.946 

1.0422 

0.3224 

0.3251 

1.099 

1.0633 

0.3245 

0.3307 

1.276 

1.0494 

0.2945 

0.2987 

1.582 

1.0855 

0.3350 

0.3458 

1.722 

1.0816 

0.3479 

0.3574 

50 

0.106 

0.9893 

0.4915 

0.4917 

0.752 

1.0270 

0.2043 

0.2061 

0.915 

1.0230 

0.1997 

0.2010 

1.112 

1.01S4 

0.1912 

0.1918 

1.353 

1.0339 

0.1958 

0.1988 

1.645 

0.0867 

0.1876 

0.2067 
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Figure  S.3.  Mean  value  of  the  smoothed  estimator  of  the  failure  rate  for  samples 
Failure  of  size  10  from  a Weibull  distribution  (Window  width  0.3S6) 


Figure  5.4,  Mean  value  of  the  smoothed  estimator  of  the  failure  rate  for  samples 
Failure  of  size  50  from  a Weibull  distribution  (Window  width  0.106) 
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